1 link tagged with all of: superintelligence + recursive self improvement + singularity + handoverism
Click any tag below to further narrow down your results
Links
Rux Andrea Bio, writing after three weeks in San Francisco, reports that many AI lab insiders and safety researchers see "handover" to a superintelligent AI as an acceptable or even good outcome. She argues the vision is vague, undemocratic, and closer to dystopia than utopia.
- Some researchers, including a lab builder she quotes, see humanity ceding control to a superintelligence after recursive self-improvement as likely and tolerable, with p(doom) estimates of 10 percent or higher circulating.
- Handoverism is loosely defined: the author estimates 30-40 percent of the outside AI safety community holds some version of it, with prominent figures like Scott Alexander favoring a benevolent "God" AI.
- The author argues handover offers no clear account of democracy, consent, labor, or purpose for humans, so even "happy" scenarios may lose most of what people value.
handoverism
+ scott alexander
recursive self improvement
superintelligence
+ ai safety
+ pdoom
singularity